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SUMMARY 


^Camouflage  is  a broad  concept  Incorporating  the  notions  of  hiding, 
blending,  disguising,  or  decoying  to  achieve  countersurvel I lance  (CS)  and 
counter  target  acquisition  (CTA).  Both  concealment  and  deception  are  Involved. 
The  purpose  of  camouflage  is  by  passive  means  to  deny,  degrade,  deceive,  delay 
or  otherwise  Interfere  with  hostile  surveillance  of  friendly  forces.  The 
systems  devised  to  accomplish  these  purposes  are  supportive  rather  than  primary 
in  their  combat  roles.  Their  contribution  to  accomplishing  the  combat  mission 
is  Indirect,  such  as  enhancing  survival  of  primary  firepower,  enabling  movement 
with  reduced  materiel  losses,  and  reducing  casualties.  ‘Camouflage  measures  of 
effectiveness  (MOE)  thus  must  measure  both  the  direct  performance  of  CS/CTA 
systems.  In  terms  of  reduced  target  detectlon/recognitlon/identlf Icatlon,  and 
the  Indirect  or  consequential  performance  effects.  In  terms  of  Increased  sur- 
vival and  reduced  mater  lei /personnel  losses.^ 

For  a given  camouflage  concept,  there  Is  no  single  MOE  that  will 
describe  all  the  qualities  that  are  desired.  Different  perspectives  or  percep- 
tions of  the  camouflage  and  deception  needs  cover  top  broad  a range.  Four 
levels  of  MOE  seem  appropriate,  viz.,  design,  system  operations,  tactical 
operations,  and  force.  The  Design  level  utilizes  measures  of  quality  and  per- 
formance to  assess  the  feasibility,  physical  characteristics,  and  technology 
of- the  materials,  components,  and  systems  proposed  for  camouflage.  This  level 
might  easily  be  divided  Into  two  parts  to  distinguish  between  (I)  the  physical 
evaluation  of  design  alternatives  and  (2)  the  application  evaluation  of  design 
performance  in  the  underlying  technical  areas,  such  as  electromagnetics 
optics,  radlometry,  photometry,  and  human  psychometrics  or  psychophysics.  The  ■ 
System  operatfcri  level  extends  the  design  viewpoint  further  Into  the  mission 
configuration,  utilizing  MOE  related  directly  to  target  perceptibIMty  by  sensor 
systems.  The  Tactical  operations  level  MOE  Introduce  the  engagement  environment 
in  some  detail  to  assess  .probabllltl.es  of  detection,  recognition,  'Identification, 
and  survival  In  events  where  camouffage  may  be  employed.  The  Force  level  MOE 
assess  combat  effectiveness  when  camouflage  and  deception  are  added  to  the  force 
and  are  expressed  In  terms  of  survivabl I ity  of  friendly  forces,  exchange  ratios, 
resources  consumed  or  lost,  and  territory  gained  or  lost.  If  the  processes  of 
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Intelligence  and  decision/action  deriving  from  surveillance  were  better  under- 
stood, this  level  might  be  divided  Into  two  parts  to  distinguish  between  (I) 
measures  of  camouflage  effectiveness  in  terms  of  Intelligence  collection  time/ 
effort  as  Interpretation-processing  and  (2)  the  combat  results  MOE. 

The  tools  available  for  camouflage  assessments  in  this  assessment 
hierarchy,  ranging  from  the  lowest,  most  detailed  technology  level  to  the  highest 
aggregated  combat-outcome  level,  reflect  the  character  and  perspective  of 
analysis  at  each  level.  They  Include  analytical  (or  physical)  models,  design/ 
laboratory  experiments,  one-on-one  models  and  simulations  of  sensor-target 
Interactions,  controlled  laboratory/f leld  experiments,  hlgh-resolutlon  models 
of  the  combat  processes,  controlled  field  experiments/exercises,  and  war  games. 

The  time  and  costs  associated  with  experimental  assessments  are  highly  sensitive 
to  the  large  number  of  variables  and  parameters  Involved  In  the  full  range  of 
experiments  that  may  be  needed  for  the  complex  camouflage  problem.  Realistically, 
most  of  the  assessment  burden  will  have  to  be  borne  by  analysis,  modeling, 
simulation,  and  gaming  techniques.  Effectiveness  test  and  evaluation.  Including 
laboratory/f leld  experiments,  can  provide  essential  data  to  verify  the  design, 
validate  and  calibrate  the  analysis  work,  verify  the  systems,  tactical,  and 
force  performance  measures,  and  conduct  maneuver  trials  for  demonstration  and 
acceptance  judgments  of  camouflage  systems. 

The  status  of  the  one-on-one  models,  the  higher-echelon  tactical 
models,  and  the  gaming  methods  Is  an  Important  consideration.  These -models  and  j 

methods  serve  as  transition  media  from  one  MOE  level  to  another  and  must  be  j 

developed  to  a point  where  they  have  broad  credibility  and  acceptance.  The  | 

one-on-one  models  examined  have  limited  but  useful  capabilities  for  analyzing  | 

I 

and  assessing  camouflage  and  deception  concepts  or  designs.  Modification  and  | 

improvement  seems  feasible  to  extend  their  applicability  and  effectiveness.  i 

There  Is  room  for,  and  a need  for,  the  development  of  similar  models  of  l.imlted  i 

situations  to  extend  assessment  capabilities  In  this  category. 

The  hlgh-resolution  combat-analysis  models  now  in  use  by  the  U.  S.  Army 
have  some  capabilities,  though  marginal,  for  camouflage  and  deception  assessment. 
Modification  and  improvement  of  these  capabilities,  along  with 
of  these  models,  can  provide  MOE  and  useful  assessment  tools. 
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The  gaming  methods  and  war  games  now  In  use  by  the  U.  S.  Army  appear 
Insensitive  to  camouflage  and  deception  factors,  except  In  the  case  of  direct 
Input  by  game  control.  These  methods  are  costly  to  Implement  and  operate,  and 
cannot  presently  accommodate  the  Intel  IT  gence-procosses  analysis  that  Is  critical 
for  assessment  of  camouflage  and  deception.  There  Is  need  for  development  of 
IntvelTIgence  analysis  capabilities  to  support  measurement  of  the  counter 
decision/action  effects  and  the  military  worth  of  camouflage  and  deception  In 
order  to  conduct  realistic  war  game  analysis  of  these  Influences  on  battle 
outcomes. 


MEASURES  OF  EFFECTIVENESS  FOR  CAMOUFLAGE^ ‘ ^ 

by 

D.  L.  Farrar 


Introduction 


New  Importance  Is  being  attached  to  current  and  future  U.  S.  Army 
capabilities  In  the  tactica.l  and  technical  problem  areas  of  camouflage, 
countersurvel I lance,  and  counter  target  acquisition.  These  capabilities  have 
as  their  purpose  the  denial  or  degradation  of  hostile  surveillance  of  friendly 
forces  so  as  to  deny,  degrade,  deceive,  delay,  or  otherwise  Interfere  with  enemy 
target  acquisition  or  analysis  of  Information  about  these  forces,  thel.r  strength, 
materiel  composition,  location,  and  Intent.  For  purposes  of  this  paper,  the 
terms  camouflage,  countersurvel'l.lance,  and  counter  target  acquisition  may  be 
used  Interchangeably  depending  on  the  tactical  situation  being  discussed  but 
camouflage*  Is  considered  the  more  Inclusive  term. 

New  emphasis  Is  being  placed  on  ways  of  achieving  camouflage  and 
deception  to  provide  Improved  security  and  survival  for  U.  S.  Army  forces  In  the 
field.  New  and  improved  techniques  and  devices  are  being  developed  to  augment 
and  complement  present  camouflage  materiel,  methods  and  procedures.  All  such 
techniques  and  devices  will  require  evaluation  and  assessment  to  determine 
their  contribution  to  mission  success  and  their  effectiveness  for  achieving 
camouflage  goals.  Various  means  may  be  selected  to  perform  these  evaluations. 
Including  laboratory  tesFs,  modeling,  simulation,  gaming,  field  experiments,  and 
field  exercises.  In  any  case,  suitable  measures  of  effectiveness  will  be  re- 
quired to  accommodate  the  various  levels  of  perspective  from  which  camouflage 
may  be  evaluated. 


* Camouflage,  as  defined  In  AMCR  70-58,  can  be  summarized  as  the  use  of 

concealment  (the  intentional  denial  to  surveillance  of  an  object,  signature, 
signal,  or  other  evidence  normally  through  blending,  hiding,  and  disguising) 
to  minimize  the  probability  of  detection  and/or  Identification  of  troops* 
materiel,  equipment,  and  Installations. 
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Fundamentally,  what  Is  required  as  a basis  for  selecting  measures  of 


effectiveness  Is  a thorough  definition  and  appreciation  of  the  camouflage 
assessment  problems  In  a'i  aspects.  The  definition  and  assessment  represents 
an  Initial  step  toward  the  development  of  reliable  and  comprehensive  means  of 
evaluating  camouflage  and  deception  effectiveness  (e.g.,  through  modeling, 
simulation,  gaming,  and  tests)  with  full  regard  for  the  concerns  expressed  about 
the  uses,  limitations,  and  constraints  of  existing  evaluation  tools  and 
techniques. 


The  Measures  Problem 

Camouflage  and  deception,  as  applied  in  the  context  of  counter- 
surveillance  and  counter  target  acquisition,  are  Intended  to  improve  the  combat 
effectiveness  of  ground  forces.  A principal  question  is.  How  to  measure  this 
contribution  to  the  combat  effectiveness  of  a force?  By  relating  changes  In 
the  battle  outcome  to  changes  in  the  characteristics  of  camouflage  and  deception 
systems?  By  relating  changes  In  survival  ratios,  with  and  without  camouflage 
and  deception,  to  the  range  and  search  times  for  target  detection/recognition, 
or  the  probabilities  of  detection/recognitlon/identif icatlon?  What  means  are 
available  now  to  analyze  simulated  combat  that  are  also  sensitive  to  camouflage 
and  deception  characteristics? 

It  is  Important  for  these  purposes  to  generate  convincing  arguments 
and  quantitative  results  that  show  whether  camouflage  and  deception  can  be 
cost-effective  elements  in  Interacting  with  opposing  sensors  and  tactical  forces. 
There  Is  need  to  show  whether  a commander,  who  can  effectively  deceive  the  enemy 
as  to  his  location,  strength,  and  intentions.  Increases  his  chances  of  survival 
oh  the  battlefield.  As  surveillance,  target  acquisition,  and  tactical  weapons 
become  more  sophisticated,  the  detection,  recognition,  and  Identification  of 
firepower  elements,  important  materiel  Items,  and  installations  virtually  assures 
their  destruction. 
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The  term,  "measures  of  effectiveness".  Is  used  -to  denote  an  Indicator 
or  Index  of  some  desired  accomplishment  or  effect.  The  measure  has  dimensions 
of  amount  or  capacity,  or  degrees  of  something  ascertained  to  bo  In  fulfillment 
of  that  desired  effect.  The  overall  measure  of  effectiveness  serves  as  a basis 
or  standard  of  comparison,  or  as  a criterion  comparing  the  measured  quantity 
with  a standard  or  with  other  measures  of  like  kind. 

The  measures  of  effectiveness  (MOE)  of  Interest  here  are  those  capable 
of  Indicating  the  degree  of  success  or  accomplishment  of  camouflage  and  decep- 
tion In  the  countersurvel I lance  and  counter-target-acqulsltlon  (CS/CTA)  applica- 
tion In  any  given  set  of  conditions.  The  purpose  of  these  passive  countermeasures 
Is  to  Inhibit  or  degrade  hostile  surveillance  of  friendly  targets;  hence,  the  MOE 
are  expected  to  show  that  degradation  In  relation  to  some  camouflage  or  deception 
characteristic,  and/or  the  effects  such  degradation  may  have  on  combat  mission 
success. 

The  preceding  paragraph  contains  deceptively  simple  statements  about 
an  exceedingly  complex  situation.  Success  depends  on  a large  number  of  variables 
that  can  significantly  Influence  both  the  immediate  sensor-target  interaction 
and  the  consequences  In  terms  of  combat  results.  Examples  are  Illustrated  In 
the  following  table. 

TABLE  1.  EXAMPLES  OF  VARIABLES  AND  MOE 
IN  THE  CAMOUFLAGE/DECEPTION  SITUATION 


Variables 


Target  signatures 
Tactical  engagement  situation 
Env I ronrnenta  I factors 
Quality  of  hostile  surveillance 
Tactics  of  hostile  surveillance 
Performance  of  enemy 
Intel  I Igence  system 


Measures  of  Effectiveness 


Signal /contrast  thresholds 
Geometry/ 1 1 ne  of  sight 
Weather/ i 1 1 umi nation 
Number/sensItIvity  of  sensors 
Location/coverage  of  sensors 
Timeliness/accuracy  of  intelligence 


r‘ 

i i 
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Each  of  theso  situation  variables  Introduces  Its  own  set  of  possible  measures 
that  can  describe  some  aspects  of  the  CS/CTA  problem.  Because  of  this  complexity, 
It  Is  not  surprising  to  find  that  It  Is  Impossible  to  state  my  single  measure 
of  effectiveness  that  Is  useful  In  directly  evaluating  more  than  a few  situations 
at  one  time  or  more  than  a limited  segment  of  the  wide  spectrum  of  possible 


camouflage  and  deception  concepts  that  might  be  employed  In  these  situations. 

Furthermore,  the  camouflage  and  deception  concepts  themselves  make 
measurement  complicated.  The  systems  devised .to  accomplish  these  concepts  are 
supportive  rather  than  primary  In  their  combat  roles.  These  systems  do  not 
contribute  directly  to  firepower  or  mobility  or  to  any  other  direct  effect  In 
accomplishing  the  combat  mission.  Instead  they  contribute  Indirectly  to  the 
achievement  of  the  combat  mission  In  a number  of  ways,  such  as  enhancing  the 
survival  of  primary  firepower,  enabling  movement  with  reduced  materiel  losses, 
or  reducing- casualties  during  the  combat  engagement.  Measures  of  effectiveness  • 
thus  must  measure  both  the  direct  performance  of  the  CS/CTA  systems.  In  terms 
of  reduced  target  detectlon/recognltlon/ldentlf Icatlon,  and  the  Indlrect-or 
consequential  performance  effects.  In  terms  of  Increased  survival  and  reduced 
materiel /personnel  losses.  Obviously  at  least  several  MOE  are  required  to  do 
this  for  any  given  system  concept. 


Concepts  of  Measurement 


The  concepts  of  measurement  applied  In  an  examination  of  camouflage 
and  deception  are  fundamental  In  defining  appropriate  measures  of  effectiveness. 
Theso  concepts  may  embrace,  on  the  one  hand,  theoretical  or  abstract  expressions 
of  relationships  among  the  various  camouflage  parameters;  or,  on  the  other  hand, 
■they  may  reflect  experimental  measurements  made  by  direct  means  In  observations 
of  real  or  analog  camouflage  devices  and  operations. 

The  entire  realm  of  the  measures  of  effectiveness  environment  Is  aptly 
Illustrated  In- FI  cure  I.  On  the  left  in  this  figure  are  the  more  theoretical 
or  abstract  areas  of  analysis  and  the  analytical  techniques  applied  In  conducting 
quantitative  inquiry  into  the  character  and  performance  of  camouflage  and  de- 
ception system  structures  and  their  elements.  In  this  area,  the  measures  of 
effectiveness  tend  to  be  well  defined,  and  in  fact  are  an  Integral  part  of  the 
analysis  structure  itself.  It  Is  this  area  of  MOE  and  systems  analysis  with 
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FIGURE  1.  THE  MEASURES  OF  EFFECTIVENESS  ENVIRONMENT 

which  this  report  Is  primarily  concerned.  Normally  the  process  of  analysis 
would  employ  models,  I.e.,  abstract  representations  of  reality  which  are  used 
•for  the  purpose  of  prediction  and  the  development  of  an  understanding  about  the 
real-world  processes.  Processes  In  which  appropriate  MOE  would  be  used  In  this 


context  Include  ■ 


• Analysis;  Analytical  models  comprised  of  sets  of  mathemat-Ical 
equations  that  "model”  all  the  basic  events  and  activities  of 
the  process  being  described;  an  overall  assumed  mathEmat leal 
structure  of  the  process  into  which  the  event  or  activity 
descriptions  are  Integrated. 


V 


• One-on-one  models;  Deterministic  or  probabilistic  models  which 
contain  events  and  variables  that. define  the  Interaction  between 
sensors  and  targets,  either  singly  or  In  combination. 

• Simulations;  Models  representing  events  In  different  combat 
processes,  essentially  In  sequence,  with  decisions  based  on 
predetermined  rules  programmed  into  the  automated  evaluation 
procedure. 


• Hlgh-resolutlon  models:  -Models  used  to  describe  the  basic 
combat  processes  of  firepower,  mobility.  Intelligence,  logistics, 
and  command  and  control,  with  the  level  of  detail  (or  smallest 
unit  Considered  as  a basic  element)  down  to  battalion,  company 
unit,  or  Individual  weapon;  estimate  the  output  of  combat 
engagements  In  terms  of  casualties,  survivors,  resource  expen- 
ditures, terrain  controlled,  etc. 

e Games:  Models  of  conflict  situations  In  which  opposing  players 
decide  upon  the  courses  of  action  to  fol low  on  the  basis  of  their 
knowledge  about  their  own  situation  and  Intent Ions, and  Information 
(Incomplete  to  some  degree)  about  their  opponent's  courses  of 
action. 

• War  games:  Models  and  game  play  In  which  Individuals  simulate 
decisionmakers  In  real  life,  using  their  Judgment  to-  perform 
decision  functions  within  the  events  or  activities  represented. 

p Structured  judgment:  An  ordered  process  of  systematically 
• describing  the  events  and  relationships  In  a combat  scenario; 
provides  a qualitative  rationale  for  cause  and  effect  that  permits 
assessment  of  the  progressive  states  of  friendly  systems,  threat 
systems,  and  the  combat  environment  as  the  combat  events  unfold; 
determines  preferred  alternatives  (e.g.,  systems  and  their  per- 
formance) on  the  basis  of  mission,  resources  expended,  and 
estimated  engagement  outcome. 

On  the  right-hand  side  of  the  MOE  environment  depicted  In  Figure  I 
are  the  experimental  areas  in  which  valid  data  for  evaluating  MOE  are  obtained. 

In  this  area,  the  measurement  concepts  are  those  associated  with  the  experiment,  . 
test,  cr  exercise.  At  the  laboratory  experiment  and  test  level,  the  MOE  take 
the  form  of  test  statistics  that  describe  specific  performance  variables.  Typical 
examples  might  Include  line-resolution  limit  of  an  optical  array,  modulation 
contrast  under  given  brightness  conditions,  signal-to-nolse  ratios,  reflected 
energy  levels,  and  similar  physical  parameter  measures.  Such  measures  .are 
described  more  fully  In  subsequent  sections  of  this  report. 

Field  experiments  and  field  exercises, Introduce  a still  broader 
category  of  measurement  concepts  having  to  do  with  how  Wei  I camouflage  and  de- 
ception systems*are  used  by  troop  units  under  more  or  less  realistic  conditions. 
Statistical  measures  typically  Include  detection  range,  search  time  prior  to- 
detection  or  recognition,  the  number  and  rate  of  targets  detected  and  located, 
percentage"  of  decoys  discriminated,  tactlcaj  intelligence  performance  In  terms 
of  number. and  percent  of  targets  correctly  identified,  incorrectly  Identified, 
or  missed  entirely,  etc.  In  addition,  there  are  also  subjective  judgmen-f  measures 
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that  may  be  applied  to:  achieving  mission  objectives,  the  ease  of  tactical 
maneuver,  or  the  ease  or  difficulty  of  mission  accomplishment  when  camouflage 
or  deception  techniques  are  employed.  In  complex  tactical  situations.  It  Is  not 
expected  that  all  significant  factors  can  be  quantified.  Assessment  of  camou’ 
flage  and  deception  In  the  field  will  always  Involve  command  judgments  about  the 
contribution  of  these  elements  to  favorable  or  unfavorable  conditions  In  the 
' ‘ combat  engagement. 

Levels  .of  Measures  of  Effectiveness 

It  Is  clear  that  for  broadly  applied  and  pervasive  system  concepts, 
such  as  camouflage  and  deception,  there  are  many  possible  concepts  of  measurement 
and,  associated  with  these,  many  possible  .measures  of  effectiveness.  The  choice 
of  MOE  win  'depend  on  the  system  being  examined,  the  method  used  to  perform  the 
examination,  and  the  vlewpo.Int  of  the  evaluator.  The  choice  of  MOE  will  largely 
determine  what  Is  Important  and  what  Is  not. 

What,  then,  are  the  kinds  of  MOE  appropriate  for  assessment  of  camou- 
flage and  deception?  What  are  the  most  relevant  levels  of  MOE  consistent  with 
the  evaluator’s  perspective  of  the  camouflage  and  deception  problems?  Researching 
these  questions  In  detail  has  led  to  the  conclusion  that  there  Is  no  single 
level,  single  assessment  step,  or  single  measure  of  effectiveness  that  Is  ade- 
quate for  all  purposes  or  all  viewpoints.  Instead  there  Is  a series  of  assess- 
■ ‘ments  corresponding  to  the  scope  (perspective)  or  level  of  the  questions  being 
asked  about  the  camouflage  .and  deception  problem  and  all  of  Its  ramifications. 
Figure  2 Illustrates  an  assessment  hierarchy  constructed  of  such  a series  of 
assessments  with  MOE  for  design,  systeips' operations,  tactical  operations,  and 
force  levels. 

The  assessment  steps  begin  af.the  lowest,  or  basic  technology,  level 
with  the  narrowest,  most  limited  questions,  and  expand  to  the  highest  or  combat- 
outcome  level  with  the  broadest,  most  Inclusive  questions-.  Each  step  up  from 
lowest  to  highest  Is  dependent  on  the  preceding  step  for  evaluating  the  camou- 
flage and  deception  perform§rice  parameters  needed  to  quantitatively  resolve  the 
events  arid  activities  at  tfils  next  higher  aggregation  level.  This  sequence  of 
assessment  and  MOE  corresponds  to  the  ascending  order  of  perspective.  Increasing 
In  scope  and  generality  from  detailed  design  assessment  up  to  assessments  of  the 
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mli  rtary  worth  of  camouflage  and  deception.  The  latter  are  more  Important  In 
support  of  decisions  on  resource  allocation  and  force  studies  at  the  highest 
decision  levels. 

At  the  design  level,  technology  Is  especially  Important  In  determining 
the  relationship  between  the  sensor  and  the  target.  At  this  level,  effectiveness 
Is  most  clearly  described  In  terms  of  technical  performance  parameters  and 
physical  phenomena,  such  as  the  materials  properties  of  the  camouf lage/deceptlon 
designs,  apparent  target-to-background  contrasts,  and  sensor/detector  responses 
to  specific  target  signatures.  The  systems  operations  level  extends  the  design 
viewpoint  further  Into  the  mission  configuration,  elaborating  on  the  designs  and 
their  applications  In  CS/CTA.  Performance  Is  assessed  through  systems  operations 
measures  In  one-on-one  system  models  or  In  tests  of  the  camouflage  systems  In 
operations  context.  The  system  capabilities  of  the  sensors  (visual /photographic. 
Infrared,  radar,  acoustic,  seismic,  and  chemical)  relate  directly  to  the  taroet 
perceptibility  In  such  effectiveness  measures.  At  the  next  higher  tactical 
operations  level,  the  tactical  maneuver,  firepower  and  environment  enters  Into 
effectiveness  in  the  form  of  engagement  conditions,  probable  detection  ranges, 
time  rate  of  target  acquisition,  detectlon/recognitlon/ldentif Icatlon  by  sur- 
velllance  means,  and  the  consequences  of  these  events,  such  as  probability  of 
survival  of  the  target  with  or  without  camouflage.  At  the  higher  echelon 
decision  or  force  levels  (e.g..  Headquarters,  Army  Materiel  Command  and  Head- 
quarters, Department  of  the  Army),  effectiveness  relates  to  the  military  value 
of  camouflage  and  deception  In  comparison  with  many  other  options  that  may  be 
exercised  to  Improve  combat  effectiveness.  The  measures  of  effectiveness  at  this 
level  deal  with  questions  such  as:  ”How  much  Is  the  combat  effectiveness  of  a 
ground  force  changed  when  camouflage  and  deception  are  added  to  the  for.ce?"; 

**How  does  the  change  In  effectiveness  from  Improved  camouflage  and  deception 
compare  with  that  from  an  equal  cost  addition  of  maneuver  elements?'*  Successful 
development  and  conduct  of  a camouflage  and  deception  program  Is  critical ly  de- 
pendent on  clearly  defining  effectiveness  by  means  of  appropriate  measures  and 
being  able  to  Illustrate  quantitatively  through  modeling,  simulation,  and 
analysis  that  camouflage  and  deception  can  make  a legitimate  contribution  to  the 
future  effectiveness  of  a field  army. 

It  Is  further  concluded  that  any  one  of  the  assessment  steps  In  the 
series  cannot  by  Itself  satisfy  the  decision  requirements.  Each  level  of  assess- 
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ment  Illustrated  In  Figure  2 has  unique  requirements  for  Input  data,  scppe  and 
detail  of  assessment,  MOE,  and  output  In  terms'of  value  statements  corresponding 
to  the  level  of  perspective  of  the  evaluator. 

The  models  and  assessment  methods  Indicated  In  the  several  assessment 
blocks  are  discussed  In  subsequent  sections  and  appendices  of  this  report. 

In  summary,  the  four  useful  levels  of  MOE  are  shown  In  Table  2 In 
correspondence  with  the  several  perspectives  that  address  the  problem  of 
measuring  the  value  of  camouflage  and  deception.  In  genera!  terms,  the  Input, 
methods  of  analysis,  and  output  associated  with  each  perspective  and  level  of 
MOE  proceeds  upward  from  the  design  level,  with  the  output  of  each  level  providing 
Input  to  the  next  one  above. 

If  further  breakdown  of  the  levels  of  MOE  Is  required.  It  would  be 
reasonable  to  subdivide  the  design  measures  Into  several  categories  depending 
on  the  state  of  development  of  the  particular  Item  being  considered.  In 
addition,  at  the  tactical  operations  level,  suitable  Intelligence  measures  of 
effectiveness  as  they  are  developed  can  be  reasonably  considered  as  a logical 
subdivision  In  the  levels  of  MOE. 

Design  Measures 

The  measures  of  effectiveness  at  the  de'slgn  level  are  specifically 
related  to  the  design  Item  characteristics.  Basically,  they  are  concerned  with 
design  feasibility,  specification,  and  producibi  I Ity.  Measures  on  this  level  . 
tend  to  be  uniquely  associated  with  particular  camouf lage/deceptlon  designs. 

They  naturally  depend  rather  specifically  on  certain  technloal,  relationships 
and  are  difficult  to  generalize. 

Measures  of  quality,  ss  compared  with  some  appropriate  standard,  are 
forms  of  effectiveness  statements*,  these  are  basic  measures  useful  In  the 
camouflage  problem.  They  are  too  numerous  and  too  well  known  to  describe 
here  In  detail! 


* e.g.  In  electromagnetics:  scatter  cross  section,  conductivity,  propagation, 
polarization;  In  optics;  absorption,  diffraction,  emission,  resolution;  In 
radlometry;  Irradiance,  reflectance,  spectral  emittance;  In  photometry; 
luminous  Intensity,  brightness,  photoemisslon,  photoconductivity. 
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FIGURE  2.  AN  ASSESSMENT  HIERARCHY 


TABLE  2.  LEVELS  OF  MEASURES  OF  EFFECTIVENESS  (MOE) 
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Measures  of  performance  .on  the  other  hand  Imply  some  function  to  be 
performed,  e.g.j  contrast  reduction  or  target  signature  change.  -The  designer 
routinely  approaches  this  problem  with  some  particular  goals  snd  conditions  In 
mind.  He  notes  the  camouflage/deception  objectives,  the  threat,  and  the  environ- 
ment, and  selects  possible  approaches  for  analysis,  experiment,  and  test.  This 
process  and  the  design  MOE  related  to  performance  might  take  the  form  Illustrated 
In  Table  3.  For  the  equipment  Items  of  Interest,  the  mlsslon/objectlve  Is  to 
deny,  reduce,  or  dilute  detection  by  hostile  sensors.  The  target  signatures  and 
cues  exposed  to  the  hostile  sensors  In  the  engagement  scenarios  form  the  basis 
for  analyzing  the  camouf lage/deceptlon  problem.  Consideration  also  must  be  given 
to  other  alternative  ways  of  protecting  the  equipment  Items  In  the  given  environ- 
ment. The  design  approach  selected  Is  then  Implemented,  analyzed,  and  tesfed, 

•i 

utilizing  measures  of  effectiveness  of  the  kind  Indicated  In  Table  3. 

Following  through  the  remainder  of  the  design  procedure,  it  Is  obvious 
that  there  are  many  "measures”  that  may  be  appi led  to  compare  and  select  a 
preferred  design.  Some  of  these  measures  may  be  used  as  MOE. 

Although  design  measures  expressing  quality  and  performance  at  this 
lowest  level  In  the  assessment  hierarchy  are  fundamental  In  the  evolution  of 
camouflage/deception  capabilities.  It  Is  not  difficult  to  see  that  effectiveness, 
as  viewed  from  different  perspectives,  cannot  be  estimated  or  assessed  without 
projecting  the  design  approach  forward,  at  least  through  the  systems  operations 
and  tactical  operations  levels,  where  the  consequences  of  performance  can  be 
assessed.  This  Is  what  the  assessment  hierarchy  (Figure  2)  Indicates  must  be 
done  to  satisfy  evaluation  needs  at  various  levels.  In  practice  this  Is  accom- 
plished Initially  as  part  of  the  design  process,  utlMzIng  the  analysis  techniques 
of  modeling,  .simulation,-  and  gaming  prior  to  design  tests  to  assess  desJgn  resuits 
and  design  alternatives. 

System  Operations  Measures 

In  the  previous  discussion,  systems  MOE  have  been  treated  In  a more 
or  less  general  manner,  so  as  to  show  their  variety  and  how  they  relate  to 
different  levels  of  perspective  on  the  problem  of  camouflage  and  deception.  In 
order  to  be  more  specific.  It  Is  useful  to  concentrate  on  a particular  level  of 
analysis. 
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TABLE  3.  ELEMENTS  OF  A GAMGUFLAGE/ 
DECEPTION  DESIGN  PROCESS 


Design  Process  E1  ements 


State 

Goals/Kiss  Ions/  Identify  equipment  Items  of  Interest  as  target 

Objectives  objects  to  be  camouflaged 

Conceal  from  (deny  Item  detection  by)  hostile  sensors 
Deceive  (reduce  Item  detection  by)  hostile  sensors 
Confuse  (dilute  Item  .detection  by)  hostile  sensors 


Define 

Threat  and  Environment  Hostile  sensing  techniques 

Target  signatures 
Engagement  environments 
Alternatives  to  camouf lage/deceptlon 


Select 

Approaches  Materials  which  reduce  target  contrasts 

Equipment  Item  designs  which  reduce  target  signatures 
Techniques  which  confuse  sensor  systems 


Choose 
Measures  of 
Effectiveness 


Proceed  with 
Design 


Reduction  of  apparent  target-to-background  contrasts 
(ratio  of  object/shadow  reflectance  to  background 
reflectance) 

Reduction  of  display  target-to-background  contrasts 
Reduction  of  sensor  eontrast-to-contrast-threshold 
ratios 

Reduction  of  emlsslvlty  of  ihe  target 
Reduction  of  patiern  correlations 
Reduction  of  slgnal-to-noiso  ratios 
Increase  In  faise-alarm  rates 


Material  selection 
Efficient  design 
Weight  minimization 
Cost  minimization 
Envlronmentai  puggedness 
Analysis  of  design  effectiveness 
Analysis  of  design  tradeoffs 
Manufacturing  process  seloctlon 
Specification  compliance 
Maintenance  minimization 

Other  des I gn/development  requirements  (©.gi,  human 
factors^  safety,  packaging,  transportablMty,  etc.) 
Test  and  evaluation 
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System  operations  measures,  and  the  sensitivity  measures  associated 
with  them,  are  outputs  of  the  one-on-one  models  and  simulation  models  that  are  . 
used  to  analyze  reconnaissance  and  the  countermeasures  that  may  be  used  for 
camouflage  and  deception  against  the  reconnaissance  threat.  The  one-on-one 
models  may  be  deterministic  or  probabilistic  models  which  contain  events  and 
variables  that  describe  the  Interactions  batween  sensors  and  targets  either 
singly  or  in  combination.,.  Simulation  models  are  those  which  represent  events 
In  a variety  of  combat  processes,  essentially  In  sequence,  with  decisions  based 
on  predetermined  rules  that  are  programmed  Into  the  automated  evaluation  pro-  ' 
cedure.  The  analyses  using  these  models  define  particular  situations  and  environ- 
ments In  which  the  overall  effectiveness  of  a camouf lage/deceptlon  system  of  a 
specific  design  can  be  evaluated.  Typically  the  Input  to  these  models  would 
define  sensor  characteristics  and  performance,  target  elements  and  their  signa- 
tures, background  signatures,  terrain  or  1 1 ne-of-s I ght  calculations,  weather 
conditions,  and  characteristics  and  attributes  of  the  camouflage/deception  tech- 
niques being  employed.  The  latter  might  Include  paints,  nets,  smokes/aerosols. 
Indigenous  materials  and  terrain  features,  mirrors,  visual  scattering  devices, 
microwave  absorbents,  and  opt  lea  I /geometric/heat  decoys,  etc.  Output  In  the 
form  of  system  operations  measures  might  Include  ^robabl  I It.les  of  detection/ 
recognition/identification,  slgnal-to-nolse  ^-atlos,  contrast  ratios  (reflectance  or 
emlsslvlty)  and  false  alarm  rates  related  to  decoy  detection,  etc. 

. The  number  of  possible  measures  that  can  be  useful  as  system  operations 

measures  is  naturally  large.  Many  of  these  same  measures  can  be  used  as  sensi- 
tivity measures.  A sensitivity  analysis  Is  simply  a procedure  whereby  modular 
changes  In  input  parameter  values  or  assumptions  are  made  In  order  to  ascei*tain 
the  effect  these  changes  might  have  on  the  results  of  model  output. 

It  Is  Instructive  to  observe  the  number  and  variety  of  measures  that 
may  be  associated  with  the  sensor-target  Interaction  processes  In  camouflage  and 
deception.  Table  4 lists  a number  of  factors,  many  of  which  may  be  useful  as 
measures  for  effectiveness  comparison  in  the  areas  of  visual.  Infrared,  and 
radio  frequency  processes.  The  factors  are  divided  according  to  how  they  are 
used  In  the  analysis  process;  I.e.,  descriptors,  process  variables,  comparison 
variables,  and  decision  variables.  Depending  upon  the  problem  being  analyzed, 
many  of  these  factors  measure  the  sensitivity  or  system  operations  performance 
of  a given  camouflage/deception  technique. 
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TABLE  4.  POSSIBLE  MEASURES  OF  EFFECTIVENESS  ASSOCIATED  WITH 

THE  SENSOR-TARGET  INTERACTION  PROCESSES  IN  CAMOUFLAGE  AND  DECEPTION 
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Tactical  Operations  Measures 

The  output  of  the  one-on-one  and  simulation  model  analyses  normally 
constitutes  the  Input  performance  measures  and  parameters  to  the  tactical  level 
of  analysis.  In  contrast  to  the  detailed  physical  performance  measures  at  the 
simulation  model  level,  the  tactical  operations  measures  typically  evaluate  the 
performance  of  camouflage  and  deception  tactics  In  a specific  combat  encounter 
situation. 

At  the  tactical  level  of  analysis,  there  are  not  as  many  factors  that 
may  be  useful  as  measures  for  assessment  of  camouflage  and  deception  effective- 
ness as  there  are  for  system  operations.  In  the  hlgh-resolutlon  combat-analysis 
models,  combat  results  are  expressed  primarily  In- terms  of  weapons  survivability, 
weapon  losses,  exchange  ratios,  changes  In  force  ratio,  arid  resources  (e.g., 
number  of  rounds)  expended.  However,  the  relationship  between  these  results  and 

the  performance  of  camouflage  and  deception  In  attaining  them  has  not  been  well 

• • 

developed  In  most  combat  analysis  models.  Depending  upon  the  model  design.  It 
Is  possible  to  utilize  systems  measures  that  contribute  to  the  coettbat  results. 
These  systems  measures  Include  the  following: 

• Probabl I Ity  of  detection,  recognition,  and  Identification  for 
given  sensor/target  combinations 

• Range  of  detection,  recognition,  and  Identification 

• e Accuracy  of  recognition  and  location 

• Search  time  or  effort  required  to  detect,  recognize,  and 
Identify  particular  targets 

« Statistical  measures  (e.g.,  number/percent  targets  detected, 
recognized,  and  Identified;  number/percent  targets  undetected; 
number/percent  of  decoys  or  false  targets  detected,  etc.). 

It  would  be  desirable  to  measure  the  number  of  false  targets  later  corrected 
and  labeled  as  false  targets  during  the  engagement.  Unfortunately  none  of  the 
existing  combat  analysis  models  can  assess  this  Important  event.  Significant 
modifications  of  the  models  would  be  necessary  to  accomodate  this  and  other 
Interesting  camouflage  and  deception  measures. 

Some  practical  MOE  which  are  appropriate  as  tactical  operations 
measures  are  suggested  In  Table  5.  A distinction  Is  drawn  between  countersur- 


(a)  Measurements:  Clock  (time);  scale  (distanced  counter  (number) 


% 

\ .1 

i 

velliance  measures  and  those  more  appropriate  for  counter  target  acquisition. 

This  distinction  Is  based  on  the  observation  that  counfersurvell lance  Is  Intended' 
to  gather  Intelligence,  whereas  counter  target  acquisition  Is  Intended  to  pro- 
vide fire  direction  for  destruction  of  the  targets. 

On  the  left  in  Table  5 are  the  MOE  concerned  with  the  friendly  Blue 
forces’  attempts  to  minimize  the  enemy  Red  offensive  effectiveness.  Each  MOE 
Implies  that  soma  effort  Is  required  by  Red  to  accomplish  his  purpose.  This 
effort  is  expressed  In  terms  of  time,  sorties,  or  closure  distance  (range).  If 
Blue  can  reduce  the  numerical  value  of  the  MOE  by  any  means,  then  Red  offensive 
effectiveness  Is  reduced. 

• 't 

On  the  right  In  Table  5 the  friendly  Blue  forces’  attempts  to  maximize 
defensive  effectiveness  are  again  expressed  In  terms  of  time  and  effort  required 
by  Red  to  achieve  his  purposes.  The  MOE  contain  several  qualifications  with 
regard  to  the  threshold  conditions  under  which  the  defensive  effect  Is  being 
measured.  These  are  self-explanatory  In  the  table. 

The  MOE  described  In  Table  5 are  statistical  In  nature  and  require 
only  a clock,  a scale,  and  a counter  to  perform  the  measurements.  If  MOE  of 
this  kind  can  be  developed  further  (certainly  there  are  many  other  poss/felMtles) 
and  Incorporated  In  hlgh-resolutlon  analysis  models  of  suitable  dess  it  should 
be  possible  to  obtain  the  necessary  validation  of  analysis  results  hroUi^i.  'ic 'd 
measurements  that  would  have  a minimum  of  complexity. 

• Force  Measures 

Measurement  of  the  effectiveness  of  a military  force  Is  largely  a 
■ matter  of  judgment  by  experienced  military  commanders.  Force  effectiveness 
depends  on  many  factors,  not  ail  quantifiable,  that  make  up  the  tactical 
maneuver,  situational  conditions,  command  response,  and  human  elements  Involved 
In  the  combat  process. 

As  an’ald  In  force  planning  and  in  analyzing  doctrinal  and  contingency 
problems,  war  gaming  techniques  have  been  developed  that  provide  context, 
algorithms,  and  model  structure  to  predict  the  results  of  division-  and  theater- 
level  combat.'  These  results  are  generally  expressed  In  terms  of  territory  con- 
trolled (e.g.,  FEBA  locations)  and  resource  consumption  (e.g.,  casualties  and 
equipment  losses)  as  a function  of  various  force  levels,  force  mixes,  and  force 
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anployments.  At  the  high  level  of  aggregation  In  the  division-  and -theater- 
level  models  which  were  examined  for  camouflage  and  deception  assessment.  It 
is  not  surprising  to  find  that  MOE  which  clearly  express  the  consequences  of 
camouflage  and  deception  are  nonexistent. 

Typical  MOE  and  their  definitions  as  employed  In  the  high-resolutlon 
models  and  war  games  are  shown  In  Table  6.  Evaluation  of  tactical  details,  like 
camouflage  and  deception.  Is  simply  not  considered  In  any  dSrect  way  In  these 
highly  aggregated  models.  Except  for  the  possible  Insertion  of  these  techniques 
through  controlled  Input  (predetermined  cause  and  effect),  the  war  games  struc- 
ture at  division-  and  theater- 1 eve Is  cannot  accept  details  of  this  kind  directly. 
The  possibility  remains  of  applying  simulation  and  hlgh-resolutlon  analysis 
results,  determined  off-line.  In  support  of  particular  elements  or  phases  of 
the  war  games  as  Is  now  done  for  certain  armor,  weapons,  and  small-size  unit 
engagements  In  conjunction  with  gaming  studies.  To  accomplish  this  for  camou- 
flage and  deception  will  require  explicit  determination  of  tfae  relationships 
between  MOE  for  camouflage  and  deception  performance  and  the  MOE  In  Table  6 
which  describe  battle  outcomes. 

The  most  obvious  shortcoming  In  attempting  to  assess  camouflage  and 
deception  effects  on  battle  outcomes  Is  the  absence  of  welS-iinderstood  models 
of -the  Intelligence  processes  through  which  order-of-battle  is  obtained,  and 
targets  are  acquired  and  destroyed.  This  Is  particularly  iu^rtant  In  evaluating 
countersurvel I lance  as  an  Inhibitor  In  enemy  perception  of  the  true  state  of 
things  In  the  combat  situation.  The  underlying  process  of  ’’target  development” 
basically  consists  of  two  steps; 

(1)  Detect,  -recognize,  and  Identify  (and  locate)  the  opposing 
forces  In  time  and  space  . 

(2)  Develop  Information  on  the  activity. of  those. forces. 

# 

This  Is  a continuously  evolving  process  and  an  ’’Intelligence"  model  of  the 
survel 1 lance-countersurvel I lance  Interactions  would  necessarily  have  to  account 
for  the  time-effort  variations  In  Intelligence  collection,  as  well  as  the 
Interpretation-processing  variations  In  Intelligence  estimates. 
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TABLE  5'.  TYPICAL  MEASURES  OF  EFFECTIVENESS  AND  THEIR  DEFIHITIONS 
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I 

At  present,  one  could  simply  count  the  number/percent  of  the  tactical 
units  or  discrete  targets  detected  and  correctly  recognized/ identified  over  some 
time  period  as  a measure  of  hostile  Intelligence  effectiveness,  and  conversely, 
the  performance  of  countersurveillance  measures.  A gross  MOE  of  this  kind  Is 
hardly  sufficient  for  more  than  a cursory  evaluation  of  camouflage  and  deception, 
If  Indeed  the  highly  aggregated  war  game  analyses  would  be  sensitive  at  all  to 
reasonable  variations  In  tactics  and  techniques  of  this  kind. 

It  must  be  concluded  for  now  that  there  are  no  completely  suitable 
MOE  to  apply  to  the  counter  dec  Is lon/act I on  level.  This  represents  a serious 
deficiency  In  present  capabilities  to  evaluate  and  assess  camouflage  and  decep- 
tion contributions  to  force  performance  and  battle  outcomes. 

Summary 


The  preceding  review  of  the  subject  "measures  of  effectiveness”,  as 
It  pertains  to  camouflage  and  deception,  reveals  a genera!  structure  relating 
various  parts  of  the  subject  to  one  another.  The  structure  as  developed  In  this 
study  Is  Illustrated  In  Figure  3. 

The  four  levels  of  MOE  are  I dent  if  led  as  follows.: 

• Design  (Oy?It-Jy  and  Performance)  Effectiveness 

• Systems  (Performance)  Effectiveness 

• • Tactical  (CS/CTA)  Effectiveness 

• Force  (Combat)  Effectiveness 
(Includes  Intelligence  Effectiveness) 

At  each  level  there  are  appropriate  measures  that  can  be  appl-Ied  to 
quantify  performance  so  that  effectiveness  can  be  assessed  and  alternative  ways 
of  doing  the  camouflage/deception  job  can  be  compared. 

There  Is  no  single  MOE  that  wilt  describe  all  the  qualities  that  are. 
desired.  Diffetent  perspectives  or  perceptions  of  the  camouf lage/deceptipn  needs 
cover  too  broad  a range.  Figure  3 shows  clearly  that  full  consideration  of  all 
.design  questions  at  the  design  level  should  consider  not  only  the  first-order 
capabilities,  such  as  contrast  reduction  and  signature  suppression,  but  higher 
order  measures  that  deal  with  systems,  tactics  and  force  effectiveness.  To  do 
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FIGURE  3*  STRUCTURE  OF  MEASURES  OF  EFFECTIVENESS 


*** 

this  at  the  design  level  means  that  analysis,  simulation,  and  gaming  toots  at 
least  through  the  one-on-one  and  high- resolution  models  must  be  used..  These 
analysis  methods  serve  as  transition  media  from  one  level  to  another  and  must 
be  developed  to  a point  where  they  have  credibility  and  acceptance  In  the  design 
community.  Each  method  and/or  model  requires  Input  performance  parameters  and 
quantities  from  lower  level  models  so  that  the  progressively  greater  aggregation, 
less  detail,  and  broader  scope  viewpoints  can  lead  to  understanding  of  camouflage 
effectiveness  at  the  real-world  combat  (force)  level  of  analysis. 

Of  course  these  steps  cannot  be  accomplished  without  performing  the 
corresponding  effectiveness  test  and  evaluation  activities  at  each  level. 
Effectiveness  T&E  must  provide  the  necessary  validation  of  the  analysis  models 
and  the  experimental /test  data  to  verify  the  design  and  the  systems,  tactical, 
and  force  performance  measures.  Effectiveness  test  and  evaluation  activities, 
using  the  same  MOE  as  the  analysis  models  Insofar  as  possible,  should  proceed 
simultaneously  with  the  effectiveness  analysis  at  each  MOE  level. 
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